#167

• At some random time, the source started throwing 403 Forbidden for the scrapes
• This was fixed in this patch with:
  • Using curl instead of Node's built-in get function to:
    • Check if the files are within the set max-size limit
    • Download the files for further processing & distribution

#168

• Tried avoiding Cloudflare's blocking on video downloads with:
  • curl
  • tls randomizations
  • user agent string randomizations
  • waiters to imitate human traffic

#169
Rewritten the Darwin video distribution service.

• Only distributes direct links

• Doesn't:

  • Spoofs TLS fingerprints
  • Rotates user-agents randomly
  • Avoids 403 blocks
  • Downloads videos
  • Transcodes videos

• The darwinCache table's schema was updated to:

  • Use different column names
  • Store the video's title

• A migration script was added, the deployment workflow should run it automatically

• Some verbose logs got commented out that spammed the journal

• Written back deployment workflow to skip CURL installs / updates on the self-hosted runner